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PRl  LIMINARY  OtVELOPMFNT  AND  VALIDATION  OF  A SCRF:LN1N(.  TECHNIQUE 
FOR  ENTRY  INTO  THE  SECURITY  POLICE  CAREER  FIELD 


I.  INTRODUCTION 

Untimely  attrition  from  military  service  re- 
presents a costly  expenditure.  With  today’s  strict 
limitations  on  defense  spending,  concern  has  been 
fix-'ussed  on  ways  to  decrease  costs  associated  with 
the  separation  of  military  personnel  prior  to  the 
expiration  of  their  normal  obligated  tour. 

In  1974.  the  Air  Force  Inspector  General 
(Security  Police Mdentided  attrition  in  the  security 
police  career  field  as  a problem  which  required 
immediate  attention.  An  unacceptable  number  of 
first-temi  security  police  were  being  identified  as 
noneffective  which  necessitated  tlieir  retraining  or 
separation  from  service.  A review  of  research  in 
tJiis  area  appears  to  indicate  that  the  problems 
experienced  by  the  Air  Force  in  selecting  effective 
sccurity/law  enforcement  personnel  also  plague 
the  other  military  services  and  civilian  law  enforce- 
ment agencies.  Studies  in  the  civilian  sector  have 
investigated  the  usefulness  of  aptitude,  interest, 
personality,  and  situational  tests  in  selecting  police 
and  reported  varying  degrees  of  success.  Criteria 
used  to  evaluate  the  utility  of  these  tests  have 
ranged  from  training  grades  (i.e.,  academic 
performance),  terminations  from  service,  and 
performance  ratings  to  specific  performance 
measures  such  as  awards,  arrests,  complaints,  and 
career  progression  (Abbatiello,  1969;  Blum, 
(ioggiii.  & Wiitmore,  1961,  DuBois  & Watson, 
1950;  Goltesman,  1969;  Kent  & Eisenberg,  1972; 
LaCouture,  I960;  McAllister,  1970;  Morman, 
Heinkey,  lleywiKid,  & Icddle,  1966;  Nowicki, 
1966,  RJicad,  Abrams,  Trosrnan,  & Margolis,  1968; 
Spencer  & Nichols.  1971).  For  the  most  part,  the 
findings  have  been  fat  from  definitive,  and  a 
majority  of  the  studies  have  investigated  only  the 
relationships  between  aptitiide/intelligcncc  tests 
and  scholastic  achievement  in  a training  environ- 
ment rather  than  actual  performance  in  the  field. 
One  of  the  most  comprehensive  studies  in  the 
selection  of  law  Enforcement  personnel  was 
initiated  in  1966  by  the  Industrial  Relations 
Center  at  tlie  University  of  Chicago  (Haehr,  1968; 
Bachr,  Furcon.  & Froemcl.  1968;  Furcon  & 
Frocrnel,  1973;  Furcon,  FroemcH,  Franc/ak,  & 
Bachr,  1971),  While  results  were  not  over- 
whelmingly optimistic,  these  studies  did  indicate 
that  certain  paper-and-pencil  tests  provided  a 
modicum  of  predictive  validity  against  actual  job 
performance  criteria. 


In  response  to  the  Air  Force  security  police 
request  for  research  assistance,  the  Air  Force 
Human  Resources  Laboratory  initiated  research  to 
develop  a screening  procedure  for  entry  into  the 
security  police  career  field.  Tlic  primary  objective 
of  the  study  was  to  develop  an  effective  screening 
procedure  which  would  reduce  costs  ass<x;iated 
with  separation  of  personnel  who  cannot  adapt  or 
cannot  eftectively  perform  security  police  duties;  a 
concomitant  goal  of  prescreening  security  police 
applicants  would  be  to  improve  the  quality  of 
security  and  law  enforcement  services  provided  to 
Air  Force  facilities. 


II.  METHOD 

The  sample  population  consisted  of  4,502  basic 
ainnen  who  had  been  assigned  during  basic 
training  to  the  security  police  career  field  or  had 
received  guaranteed  assignments  for  these  Air 
Force  specialty  codes  (AFSC  81130/81230) 
prior  to  entry  into  service.  Table  1 describes  the 
sample  population. 


Table  I.  Sample  Population  by  AFSC/ 
Sex  by  In/Out  Criterion 


AFSC/Stx 

Criterion 

In 

Out 

Total 

81  1 XX  - Male 

2,593 

237 

2,830 

812XX-  Male 

1 ,3 1 2 

81 

1 .393 

81 2XX  — Female 

260 

19 

279 

Total 

4.165 

337 

4.502 

Based  on  results  of  previous  research  (Guinn, 
Johnson,  & Kantor,  1975;  l.aChar,  Sparks,  & 
Larsen,  1974),  several  different  types  of 
paper-and-pencil  test  measures  (personal  history, 
attitudinal,  interest)  were  administered  to  the 
sample  population  prior  to  entry  into  technical 
training.  Tlie  specific  test  instruments  used  in  the 
data  collection  included: 

I.  The  History  Opinion  Inventory  (HOI).  Tliis 
inventory,  developed  by  Wilford  Hall  medical 
personnel,  is  a 100-item  self-report  inventory 
designed  to  tap  dimensions  of  school  adjustment, 
family  stability,  siKial  orientation,  emotional 
stability,  bodily  complaints,  motivation  and 
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e \pci.  t :i  I Kins  for  aducveineni,  and  response 
lowanl  aiilliorils  (IjCharet  al..  I‘)74). 

2.  Pie  Airman  Assessment  Inventorv  ( AAI). 
Pus  152  ilem  inventory  Includes  inforniatioti  on 
personal  and  lamily  background,  educational  and 
attitudinal  data,  enijiloytttent  history,  personal 
problems,  previous  criminal  involvement  or 
ex(iertntetitation  with  drugs  prior  to  entry  into 
service,  and  expressed  satisfaction  w'ith  the 
individual’s  as.signed  career  field. 

4.  Vocational  Interest  Career  Examination 
( VOICE ).  Pie  V'OICE  is  a 40()Hlem  general- 
purirose  vocational  interest  inventory  developed 
by  the  Educational  fesling  .Service  specifically  for 
use  by  the  Air  force  in  the  assignment  of  enlisted 
IX’rsonnel  to  occupational  specialties  ( Echtcrnachl. 
Keilly.  A McCaffrey  , l‘)73). 

Aplitudinal  scores  and  criterion  data  were 
retrieved  from  the  airman  record  files  maintained 
by  the  Computational  Sciences  Division  of  the  Air 
Eorce  Human  Resources  laboratory  . llie  criterion 
used  for  these  analyses  was  in-  or  oiit-of-service 
after  completion  of  technical  training.  Tlie  in- 
service  group  consisted  of  4.165  individuals  who 
were  still  on  active  duly  at  the  completion  of  then 
technical  training  phase.  The  out-of-service  group 
was  compnsed  of  those  individuals  who  had  been 
discharged  from  service  prior  to  completion  of 
technical  training.  Due  to  the  small  number  of 
individuals  who  had  actually  been  discharged  from 
service  al  the  lime  technical  training  was 
completed  (N=  .T37),  no  attempt  was  made  to 
group  those  di.scharged  into  more  siwcific  loss 
categories  lor  analysis  purposes. 

Multiple  linear  regression  analyses  (Hotlenberg 
<V  Ward.  l‘>(i.D  were  accomplislied  to  determine 
the  usefulness  of  the  aptitudinal  and  inventory 
response  data  in  predicting  adaptabililv  to  the 
security  police  career  field.  Based  on  the  results  of 
the  regression  analyses,  an  optimal  set  of 
predictors  was  selected  to  comprise  a preliminary 
screening  device.  An  optimum  cutoff  score  in  the 
predicted  score  range  was  deteniiined  which  would 
maximi/e  the  identification  of  maladaptive 
security  police  (lersontiel  yet  minimi/e  the 
exclusion  of  potentially  successful  security 
policemen. 


III.  Rl  SUI  TS  AND  DISC  I SSION 

Develupmenl  of  Predictor 
Composites 

Inventory  and  aptitudinal  data  as  shown  in 
Table  2 were  combined  into  1 1 different  regres- 
sion models.  Ideven  AAI  items  were  omitted  from 
the  analysis.  Tliese  items,  which  pertained  to  race, 
sex,  and  expressed  job  satisfaction,  were  not 
considered  appropnate  or  relevant  for  inclusion  in 
a screening  device.  It  was  believed  that  using  items 
related  to  race  and  sex  in  a screening  procedure 
would  be  in  violation  of  ct|ual  opportunity 
considerations.  Eurthermore.  items  pertaining  to 
expressed  job  satisfaction  could  not  be  assessed  at 
time  of  entry  into  the  career  field  and  would  be 
useless  in  a screening  procedure  designed  for  use- 
prior  to  entry  into  active  duty.  Tlie  VOICE'  items 
were  compiled  into  18  scales  which  had  been 
previously  developed  on  a large-scale  validation 
study  ( Alley.  Wilbourn,  & Berberich.  1476). 

Tahk'  2.  Regression  .-\nalysis 
Variables 


PredkTor  Variables 

llislory  Opinion  Invenliiry  IIIOIl  lleins  inn 

Aitnian  Assessmenl  Invenlory  I .-X  AIl  lietns  . 141 

Vocational  InIcresI  Career  I xaniinalion 

( void  I Scales  IK 

Amied  Services  Vocyilional  Vpliluile 

Hallery  Aptitiiile  liKleses  IM  V (.  I i 4 

Armed  I orcl^  <7ualil  leal  ion  lest 

t Al  (71  I I’ercenlilc  Si  ore  I 

Criterion  Variable 

In/Otil  ol  Service  at  let  ( oiiiplelion  ol 
leclinical  I i.iiiiini: 


The  first  series  of  regression  analyses  was 
accomplished  to  d<‘ter-time  whelhei  any  one  ol  the 
II  models  produced  a statistically  significant 
composite.  Results  of  these  analyses  are  presented 
m Table  .V.  All  models  reached  a level  of  statistical 
significance  at  or  beyond  the  .01  level. 

Selection  of  an  Optimal 
Test  Composite 

In  developing  a lest  composite  for  operational 
use  as  a screening  device,  an  evaluation  must  be 
made  of  the  potential  savings  to  be  .accrued  from 
the  identification  of  (xissible  eliminees  against  the 
additional  costs  and  lime  rcc|uired  to  ulili/.e  a 
more  comprehensive  screening  puK-edure,  The 
proposed  screening  battery  develoixd  for  this 


Table  J.  Summary  of  Regression  Analyses 


Full  Modal* 

R«ttr)ct«d  Modal 

r’ 

«"■ 

<•*. 

r 

Model  1 

.0138 



.0000 

5 

4,496 

12.5826* 

Model  2 

.1005 

_ 

.0000 

100 

4,401 

4.9172* 

Model  3 

.1577 

— 

.0000 

141 

4,360 

5.7894* 

Model  4 

.0782 

- 

.0000 

18 

4,483 

21.1284* 

Model  5 

.0417 

- 

.0000 

1 

4,500 

196.0041* 

Model  6 

.0834 

— 

.0000 

23 

4,478 

17.7062* 

Model  7 

.2185 

— 

.0000 

264 

4,238 

4.4869* 

Model  8 

.1975 

— 

.0000 

247 

4,254 

4.2398* 

Model  9 

.1875 

- 

.0000 

246 

4,256 

3.990fi* 

Model  10 

.1481 

— 

.0000 

123 

4,378 

6.1875* 

Model  1 1 

.1870 

- 

.0000 

164 

4,337 

6.0832* 

‘^Predictor  variables  contained  in  regression  models  are  as  follows: 

Model  1 A-SVAIi  (Mechanical.  Electronics,  (ieneraJ.  Administrative  Aptitude  Indexes)  and  AFQT  Score  (S) 
Model  2 HOI  Items  (100) 

Model  3 - AAI  Items  (136) 

Model  4 ■ VOICE  .Scales  (18) 

Model  5 - 1.E  Scale  (1) 

Model  6 - ASVAB,  AFQT,  VOICE  (23) 

Model  7 - HOI,  AAI,  VOICE,  ASVAB,  AFQT(2S9) 

Model  8 . HOI,  AAI,  LE  .Scale,  ASVAB,  AFQT  (242) 

Model  9 HOI.  AAI,  ASVAB,  AFQT  (241) 

Model  10  HOI,  VOICE,  ASVAB,  AFQT(123) 

Model  11  AAI,  VOICE,  ASVAB,  AFQT  (159) 

•p  C .01. 


Study  includes  three  additional  tests  which  would 
increase  the  overall  ettsts  of  the  operational  testing 
program.  To  minimize  these  potential  costs,  an 
effort  must  be  made  to  eliminate  tests  and/or 
items  which  would  not  make  significant  contri- 
bution to  the  prediction  of  the  in/out  criterion. 

The  second  series  of  regression  analyses  were 
designed  to  determine  whether  one  or  more  of  the 
test  instruments  aiuld  be  eliminated  without 
reducing  the  predictive  accuracy  of  the  overall 
screening  technique. 


Results  of  these  analyses  arc  contained  in  Table 
4.  Initially,  an  attempt  was  made  to  investigate  the 
possibility  of  decreasing  the  number  of  VOK'l- 
scales  by  using  only  the  Law  bnforcement  (LL) 
scale.  However,  the  comparison  between  Model  7 
and  Model  8 indicated  that  llie  other  VOICL  scales 
make  a unique  and  significant  contribution  over 
and  above  the  LL  scale  alone.  Based  on  this 
finding,  subsequent  analyses  included  all  VOICL 
scales  as  possible  predictor  variables. 


Table  4.  Summary  of  Regression  Comparisons* 


Full  Modal 

R* 

Rattrtctad  Modal 

r’ 

df, 

F 

Model  7 

.2185 

Model  8 

.1975 

17 

4,237 

6.6788* 

Model  7 

.2185 

Model  9 

.1875 

18 

4,237 

9.3451* 

Model  7 

.2185 

Model  10 

.1481 

141 

4,2.37 

2.7067* 

Model  7 

.2185 

Model  1 1 

.1870 

100 

4,237 

1.7065* 

Model  7 

.2185 

Model  I 

.0138 

259 

4,237 

4.2857* 

Model  7 

.2185 

Model  6 

.0834 

241 

4,237 

3.0398* 

'I’ri'dii  Kit  v^njbli't  fur  tpciific  models  contained  in  Table  3. 
•p  4 .01. 
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Regression  models  were  then  developed  which 
would  delete  test  measures  one  at  a time  (Models  9 
through  11),  and  comparisons  between  these 
models  were  accomplished  to  determine  whether 
one  or  more  of  the  experimental  tests  could  be 
deleted.  The  comparison  of  Model  7 versus  Model 
9 indicates  that  the  VOICE  scales  cannot  be 
deleted  from  the  selection  comprosite  without  a 
significant  decrease  in  predictive  accuracy.  Similar 
comparisons  between  Models  7 and  10  and 
between  Models  7 and  1 1 revealed  that  both  the 
HOI  and  AAl  items  also  made  significant  contri- 
butions to  the  prediction  equation. 

Based  on  these  findings,  it  appears  that  a 
combinatiin  of  all  three  experimental  test 
measures  along  with  aptitudinal  data  should  be 
considered  in  developing  an  effective  screening 
procedure  for  security  police  personnel. 

Selection  of  a Minimum 
Number  of  Test  Items 

Based  on  the  decision  to  include  all  three  test 
measures  in  the  final  predictor  composite,  final 
regression  analyses  were  directed  toward  an 
attempt  to  reduce  the  overall  length  of  the 
screening  tests  by  identifying  tlie  minimum 
number  of  variables  which  could  be  used  without 
significantly  lowering  the  predictive  accuracy  of 
the  screening  battery. 

In  accomplisliing  these  analyses,  additional 
constraints  were  imposed  on  tlie  iterative  regres- 
sion computational  process  which  would  more 
nearly  reflect  the  actual  operational  situation.  For 
instance,  all  potential  accessions  are  required  to 
take  the  Armed  Services  Vocational  Aptitude 
Battery  (ASVAB).  Therefore,  in  the  development 
of  an  optimal  number  of  predictors  from  Model  7, 
the  ASVAB  composites  (Mechanical,  Adminis- 
trative, (General,  and  Electronics)  and  Air  Force 
Qualification  Test  (AFQT)  percentile  score  were 
used  as  the  first  components  in  the  predictor 
system.  After  the  aptitudinal  data  were  included  in 
the  preliminary  predictor  composite,  all  other 
predictor  variables  were  considered  for  inclusion  in 
the  final  composite  if  they  made  a unique  and 
significant  contribution.  Tlie  final  composite  from 
this  model  contained  a total  of  158  variables 
ASVAB  and  AFQT  scores,  55  HOI  items,  11 
VOICE  scales,  and  87  AAl  items.  The  multiple 
correlation  of  this  composite  was  .46. 

Since  serious  consideration  is  currently  being 
given  to  including  the  VOICE  in  the  Air  Force 
operational  classification  and  assignment  process,  a 
similar  pnKess  was  used  to  develop  a composite 


from  Model  7 including  the  VOK'E  scales  along 
with  ASVAB/AFQT  data  as  the  basic  components 
in  the  predictor  composite.  Tlie  predictor 
composite  from  this  analysis  included  a total  of 
166  variables:  54  HOI  items,  89  AAl  items  along 
with  the  5 aptitude  scores  and  18  VOICE  scales. 
The  multiple  correlation  for  this  composite  was 
.47. 

Due  to  the  small  number  of  eliminees,  no 
attempt  was  made  in  this  preliminary  investigation 
to  cross-apply  the  regression  weights  to  determine 
the  reliability  and  stability  of  the  composites  on 
another  sample.  A follow-on  study  using  the 
in/out  criterion  after  9 to  12  months  on  the  job 
will  include  cross-application  procedures. 

Identification  of  Security 
Police  (81 XXX)  Eliminees 

Based  on  the  regression  analysis,  it  appears  that 
a Security  Police  (SP)  Selection  Composite  could 
be  developed  from  aptitude,  interest,  biographical, 
and  personal  history  data  which  would  identify 
potential  failures.  Although  the  regression 
equation  developed  from  these  analyses  is 
statistically  significant,  statistical  significance 
provides  little  information  on  the  practical 
usefulness  of  the  proposed  selection  composite.  A 
more  understandable  evaluation  of  die  SP 
composite  (Model  7)  is  contained  in  Table  5.  Tliis 
table  presents  a comparison  of  the  number  of 
personnel  correctly  identified  (i.e.,  hits)  versus  the 
number  of  personnel  incorrectly  identified  (i.e., 
false  positives  and  misses).  Hits  include  those 
security  policemen  identified  as  successful  who 
did,  in  fact,  graduate  from  technical  training  and 
those  identified  as  failures  who  were  actually 
eliminated  from  military  service.  False  positives 
are  those  identified  by  the  selection  composite  as 
failures  who  actually  graduated  from  technical 
training  and  were  still  on  active  duty.  Misses  are 
those  eliminees  identified  as  successful  security 
police.  Using  the  cutoff  score  of  .63  for  Model  7, 
94%  of  the  sample  population  who  completed 
training  were  correctly  identified.  Only  1%  of 
those  individuals  who  successfully  completed 
training  were  identified  as  potential  failures. 
Altliough  78%  of  the  actual  failures  would  have 
been  incorrectly  identified,  22%  of  the  failures 
would  have  been  correctly  identified  as  hig)i-risk. 

Althougli  results  of  this  study  appear  encour- 
aging, it  should  be  noted  that  the  regression  nuxlel 
represents  only  an  initial  effort  in  the  development 
of  a selection  methodology  for  security  police 
personnel. 
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Tahlc  5.  Hit/Miss 
Table  for  Model  7 


Actual  Oitpofltion 
Prvdictad  


Ditpotition 

In  Servlet 

Out  of  Service  ToUl 

In 

4,ni 

99',1 

2^6 

IH'Z  4.^87 

>>4% 

6% 

liMr, 

(lilts) 

( 1 also  Posilivesi 

Out 

.14 

1% 

HI 

22%  ll.l 

29T 

71% 

lOO'- 

( Misses) 

(Mils) 

lotal 

4.16.S 

loiri 

-1.17 

100':  4,502 

The  possible  monetary  savings  to  be  accrued 
from  implementation  of  the  SP  composite  can  be 
demonstrated  by  using  the  sample  population  as 
an  example.  Using  Model  7.  the  total  number  of 
security  police  personnel  who  were  identified  as 
potential  graduates  was  4,3X7;  4,131  or wen; 
actually  successful  in  completing  their  training 
program.  A.ssuming  that  4,Ui5  (the  actual  number 
who  did  graduate  from  training)  were  required  to 
meet  operational  commitments,  a total  input  of 
4,430  would  have  been  required  instead  of  4,502. 
Instead  of  the  original  number  of  337  eliminees, 
266  would  not  have  completed  the  training 
program.  Tlie  original  number  of  eliminees  (337) 
represents  an  approximate  loss  of  SI  ,068,240.  The 
lowered  number  of  eliminees  represents  a cost  of 
S843.220,  or  a savings  of  $225,070.  Wliile  the 
cost -avoidance  associated  with  the  sample 
population  is  somewhat  small,  the  savings 
as,sociatcd  with  the  total  input  into  training  would 
amount  to  considerable  savings  over  time  (N  = 
4,268  for  I475). 

(ienerally,  a more  intensive  and  refined 
screening  procedure  decreases  tlie  number  of 
available  |x;rsonnel  for  selection.  Since  out  selec- 
tion instruments  cannot  make  perfect  predictions 
of  success/ 1 ail  lire  in  every  instance,  a large  number 
of  potentially  successful  personnel  are  identified  as 


possible  eliminees.  Wlien  die  number  of  applicants 
for  entry  into  the  Air  force  exceeds  the  number 
required  for  manning,  the  impact  of  the  loss  of 
potentially  productive  personnel  is  minimized.  On 
the  other  hand,  if  security  police  requirements  for 
personnel  exceed  the  number  available  for  assign- 
ment, the  use  of  a screening  device  to  further  limit 
the  applicant  pixil  becomes  an  imiaortant  issue  to 
consider. 

Due  to  the  small  number  of  eliminees,  no 
attempt  was  made  to  cross-apply  the  regression 
weights  to  another  sample.  It  should  be  realized 
that  the  stability  of  these  nuxlels  in  predicting 
success/failure  on  future  samples  is  unknown  at 
this  time.  A follow-up  study  is  in  progress  wliich 
will  investigate  tlie  stability  and  validity  of  the 
predictor  composites  when  applied  to  a different 
sample.  It  should  also  be  noted  tliat  the  multiple 
correlation  of  the  composite  obtained  on  a sample 
population  previously  screened  by  an  operational 
selection  test  is  somewhat  lower  than  if  it  had 
been  computed  on  an  unrestricted  population, 
from  these  results,  the  two  models  apix’ar  to 
demonstrate  practical  utility  in  the  selection  of  air- 
men into  the  security  police  field. 


IV.  SI  MMAPY  ANDCONCLl’SIONS 

The  results  of  the  regression  analyses  for  the  .SP 
(8IXXX)  selection  composite  indicate  tliat  a 
screening  procedure  comprised  of  aptitudinal. 
interest,  and  ixrsonal  history  data  has  some 
practical  value  in  the  selection  of  quality  securitv 
police.  However,  if  availability  of  |vrsonnel  for 
secimty  police  assignments  decreases,  the  selection 
composites  may  be  too  strii.gent  lor  operational 
use.  In  a favorable  icuuitmg  envmmment . the  use 
of  the  SP  Selection  Composite  as  an  operational 
screening  procedure  should  be  considered 

Prior  to  the  o|X'iational  use.  it  is  considered 
mandatory  that  the  final  si-leclion  conqH>sile  be 
cross-v.ilidaled  to  additional  samples  ol  secunly 
IHilice  |X.Mv>!inel  to  ascertain  then  stability  anil 
validity 
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